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SUMMARY 


Comments  fro*  training  and  operational  personnel  over  the  past  few  years  have  indicated  that 
an  unacceptably  large  number  of  air  weapons  controllers  (AFSC  17XX)  are  not  performing 
satisfactorily  during  training  and/or  In  their  field  assignments.  Over  FYs  80,  81,  a.v'  8? 
training  attrition  rates  In  the  eight  air  weapons  controller  courses  have  varied  from  0*  to  41*: 
the  general  trend  was  Increasing  attrition  rates  froa  FY  80  through  FY  8k. 

The  primary  objective  of  this  study  was  development  of  a  selection  strategy,  based  on  Air 
Force  Officer  Qualifying  Test  (AFOQT)  scores,  for  the  air  weapons  controller  career  field.  In 
addition.  It  explored  performance  d<  ‘ferences  attributable  to  background  factors  and  documented 
aptitude  levels  of  personnel  currently  assigned  to  AFSC  17XX. 

Data  concerning  the  cost  of  FY  82  attritions  In  training  dollars  to  the  all'  weapo 
controller  training  organizations  were  analyzed  and  presented  In  the  report.  An  analysis  o: 
training  performance  data  on  968  air  weapons  controller  students  found  a  significant  and  positive 
relationship  between  AFOQT  Academic  Aptitude  composite  scores  and  successful  completion  of 
training.  These  data  were  brought  together  in  a  set  of  analyses  to  show  Impact  on  training 
dollars  lost  through  attrition  If  various  cut-off  scores  on  the  Academic  Aptitude  of  the  AFOQT 
were  employed  as  a  prerequisite  for  course  entry.  A  separate  analysis  of  background  factors, 
Including  age  and  source  of  commission,  found  no  useful  relationship  between  these  variables  and 
student  performance. 

It  was  recommended  that  the  AFOQT  be  used  as  a  screening  device  for  entry  into  air  weapons 
controller  training. 


PREFACE 


This  project  was  conducted  by  the  Air  Force  Hunan  Resources  Laboratory  (AFHRL)  to 
examine  the  relationship  between  AFOQT  composite  scores  and  success  In  Air  Force  air 
weapons  controller  (Air  Force  Specialty  Code  1741)  training.  It  was  Implemented  at  the 
request  of  Headquarters  United  States  Air  Force  (USAF/XOO).  This  report  provides  a 
summary  of  this  special  project  (AFHRL-USAS-20-25).  This  project  was  a  Joint  effort 
between  the  AFHRl  Logistics  and  Human  Factors  Division  at  Hrlght-Patterson  AFB  and  the 
AFHRL  Manpower  and  Personnel  Division  at  Brooks  AFB. 

Acknowledgements  and  grateful  appreciation  are  extended  to  Hr.  Bertram  Cream  and 
Dr.  Bruce  Gould  of  AFHRL  for  their  managerial  direction  and  support  of  this  project;  the 
military  and  civilian  personnel  at  the  air  weapons  controller  training  schools  and 
operational  units  who  gathered  and  recorded  the  relevant  student  data.  Including  Mr. 
LaBarbera,  Keesler  AFB;  MaJ  Sundstrom,  Capt  Grenade,  and  Capt.  Lee,  Tyndall  AFB;  Capt 
James  and  Capt  Celre,  Luke  AFB;  MaJ  Sheppard,  Naj  Dewey,  and  Lt  Plngrey,  Tinker  AFB;  and 
MaJ  Gardner,  Langley  AFB;  and  to  Lt  Col  Shepherd,  MaJ  Layton,  and  MaJ  Smith  (USAF/XOORC) 
for  their  excellent  support  during  the  planning  and  Implementation  of  this  project. 
Finally,  Dr.  tarry  Shadow  of  Hill  AFB,  Utah,  provided  an  especially  Insightful  review  of 
an  earlier  draft  of  the  report. 
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RELATIONSHIP  BETWEEN  AIR  FORCE  OFFICER  QUALIFYING  TEST  SCORES 
AND  SUCCESS  IN  AIR  WEAPONS  CONTRQLLt  .  TRAINING 

1.  INTRODUCTION 


Objective 

The  primary  objective  of  this  study  was  development  of  a  selection  strategy  for  the  air 
weapons  controller  Air  Force  Specialty  Code  (AFSC)  17XX  career  field  based  on  the  Air  Force 
Officer  Qualifying  Test  (AFOQT).  At  the  present  time,  this  career  field  has  no  special  selection 
criterion.  The  secondary  objectives  were  as  follows: 

1.  To  Investigate  relationships  between  AFOQT  composites  and  various  measures  of  training 
success. 


2.  To  determine  training  performance  differences  attributable  to  background  and  bio- 
demographic  factors. 

J.  To  document  current  aptitude  levels  of  personnel  assigned  to  this  career  field. 


Background 

Over  the  past  several  years  there  has  been  growing  concern  about  the  need  for  selection 
criteria  for  personnel  entering  the  air  weapons  controller  (Ar'SC  1 7XX )  career  field.  Comments 
from  training  and  operational  personnel  during  the  past  few  years  have  Indicated  that  personnel 
entering  this  career  field  have  not  been  pcifvrair.g  well  either  during  training  or  in  their  field 
assignments.  These  concerns  have  been  documented  In  several  letters  and  reports  (see  Reference 
Note  1). 


Issues 

Table  1  shows  the  attrition  rates  and  associated  costs  for  the  five  air  weapons  controller 
training  schools  (eight  courses)  for  fiscal  years  1980  through  1982.  As  can  be  seen  from  this 
table,  the  attrition  rates  differ  widely  for  each  school  and  are  not  stable  over  the  years 
covered.  In  fact,  they  range  from  a  low  of  0%  attrition  to  a  high  of  41%  attrition.  However,  It 
should  be  noticed  that  the  rates  generally  Increased  for  the  J  year  period  covered,  especially 
for  the  more  Important  courses. 

The  estimated  FY82  attrition  costs  presented  In  Table  1  are  considered  to  span  the  range  from 
extremely  conservative  (per  course-minimum)  to  liberal  (per  course-maximum),  with  the  actual 
costs  falling  somewhere  within  this  range.  Of  the  537  students  who  entered  air  weapons 
controller  training  programs  In  FY82,  88  were  eliminated  during  training.  This  16%  attrition 
rate  cost  the  Air  Force  between  2.3  and  4.6  million  dollars  In  wasted  training.  Although  the 
acceptability  of  this  cost  must  be  determined  by  HQ  USAF  and  the  Hajor  Commands  (MAJCOHs), 
establishment  of  a  selection  criterion  for  the  17XX  career  field  appears  to  be  warranted. 
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Table  1.  Attrition  Rates  end  Associated  Cost*  for  AFSC  1741  Training  Programs 


Course 

Attrition 

Estimated  Attrition  Costs  (1982)  dollars 

Tyndall  AFB 

FY 

El  1ms 

Trainees 

Rate  (*) 

Per  Student* 

Per  Course 

Minimum 

Per  Course 
Max  lmumb 

'mix-000 

80 

20 

405 

5 

81 

8 

24! 

3 

82 

28 

188 

15 

11,782 

329,896 

329,896 

1741 A-0O3 

80 

10 

131 

8 

81 

16 

97 

16 

82 

35 

86 

41 

27.671 

968,485 

968,485 

1 74 18-000 

80 

14 

141 

10 

61 

23 

120 

19 

82 

12 

74 

16 

32,92! 

395,052 

1,059,144 

Subtota 1 

1,693,473 

2,357,525 

Tinker  AFB 

E3A00C00BX 

80 

0 

15 

0 

81 

0 

11 

0 

82 

1 

25 

4 

27,024 

27,024 

148,207 

E5AOOCOODX 

80 

1 

7! 

1 

81 

6 

80 

8 

62 

11 

77 

14 

52,367 

576,257 

1.909,270 

E3AOOCOOGA 

80 

1 

17 

6 

81 

1 

26 

4 

82 

C 

23 

0 

48,514 

0 

0 

Subtotal 

603,201 

2,057,477 

Keesler  AFB 

30LR 1 7410-002 

80 

4 

36 

11 

81 

3 

111 

3 

82 

0 

23 

0 

4,280 

0 

0 

Luke  AFB 

1741FOl 

80 

1 

66 

2 

81 

0 

54 

0 

82 

1 

41 

2 

20,512 

20,512 

141,695 

Total  Estimated  Attrition  Cost  (1982) 

2.317,226 

4,556,697 

•Average  training 

costs  per 

student  were 

reported  by 

Headquarters  Air  Training 

Command  and 

Headquarters  Tactical  Air  Command.  For  estimation  purposes.  It  was  assumed  that  attrlts  averaged 
completion  of  half  the  training  program.  Therefore,  the  estimated  FY82  attrition  cost  per  student 
Is  one-half  the  training  cost. 

bThe  minimum  estimated  course  attrition  cost  Is  the  student  cost  multiplied  by  the  number  of 
attritions  for  the  course.  The  maximum  estimated  course  attrition  cost  includes  the  full  cost  of 
previous  training  and  assumes  the  student  was  trained  for  a  manual  system  (E30BP-1741-A003)  and 
transitioned  to  an  automatic  system  (1741BOO). 


Another  major  Issue  relevant  to  this  career  field  is  the  level  of  competence  of  the  students 
once  they  graduate  from  the  training  courses  and  perform  their  operational  jobs  throughout  their 
careers.  At  the  present  time,  there  Is  no  valid  empirical  methodology,  nor  adequate  detailed  job 
performance  data,  that  can  be  used  to  correlate  student  performance  during  training  with  their 
later  operational  job  performance.  MAJCOH  Standardization  and  Evaluation  programs  do  provide 
some  data  conce-nlng  operational  performance  end  are  designed  to  ensure  the  operational 
competence  of  career  field  members.  However,  many  factors  nay  affect  performance  on  these 
assessments,  such  as  unit  mission  and  tasking,  training  provided  after  formal  schooling  Is 
completed,  etc.  Because  of  these  factors,  data  from  these  assessments  cannot  be  used  to  develop 
correlations  between  performance  during  training  and  performance  In  the  field.  Implementing  an 
adequate  selection  criterion,  however,  can  be  expected  to  have  a  positive  effect  on  the 
operational  performance  of  air  weapons  controllers. 

Headquarters  USAF  requested  the  Air  Force  Human  Resources  Laboratory  to  Investigate  the 
possibility  of  recommending  minimum  cutoff  s.ores  on  the  AFOQT  as  a  selection  criterion  for 
entrance  Into  this  career  field  (see  Reference  Note  2).  The  AFOOT  was  chosen  because  It  Is  given 
to  all  potential  office's  (except  Air  Force  Academy  graduates)  and  would  not  Impose  additional 
testing  costs. 

Related  Research 

Most  of  the  previous  research  on  selection  criteria  relevant  to  air  weapons  controllers  has 
been  done  by  the  Federal  Aviation  Administration  (FAA)  for  selecting  Air  Traffic  Control 
Specialists  (ATCSs).  The  FAA  has  experimented  with  various  test  batteries  for  ATCS  selection 
Since  1962.  A  review  of  the  experience  that  the  FAA  has  had  with  their  various  selection 
criteria  from  1960  to  1980  can  be  found  In  Collins,  Boone,  and  YanDeventer  (1981).  Other 
articles  that  describe  FAA  selection  criteria  research  Include  Boone,  VanBusklrk  and  Steen 
(1980),  Cobb  (1971),  Cobb  and  Mathews  (  1  9  73),  Lewis  (  1978),  and  Mathews  and  Cobb  ( i v ?4 ) . 

In  one  of  the  studies  most  relevant  to  air  weapons  controller  selection  policy,  Cobb  (1971) 
assessed  the  usefulness  of  seven  previously  validated,  commercially  available  tests  In  predicting 
success  In  military  ATCS  training.  Although  the  composite  test  scores  predicted  success  somewhat 
better  than  the  military  aptitude  screening  measures  in  use  at  the  time  (primarily,  the  Air  Force 
General  Aptitude  Index  and  the  Marine  Corps  Military  Screening  and  Classification  Test),  Cobb 
concluded  that  the  mlllta'y  could  significantly  Improve  Its  selection  procedures  by  merely 
raising  the  minimum  scores  required  on  existing  military  screening  tests. 

II.  APPROACH 

Method 

A  questionnaire  was  developed  to  acquire  Information  on  course  content  and  duration,  to 
Identify  students,  and  to  obtain  student  performance  data,  suen  as  academic  grades,  class 
standing,  and  an  Indication  of  whether  or  not  the  student  completed  the  course.  This 
questionnaire  was  sent  to  each  of  the  five  organizations  responsible  for  training  air  weapons 
controllers  (see  Appendix).  Each  of  these  schools  was  asked  to  provide  data  for  all  students 
enrolled  from  1  October  1979  through  1  July  1979. 

Predictor  data  were  obtained  for  the  students  Identified  In  the  questionnaires  by  retrieving 
their  AFOQT  scores  from  the  AFOQT  consolidated  data  base.  The  composites  were  Pilot, 
Navigator-Technical,  Academic  Aptitude,  Verbal,  and  Quantitative. 


Tt>e  training  organizations  completed  questionnaires  on  1,465  students,  or  approximately  79* 
of  all  students  trained  during  the  period#  To  be  used  for  data  analysis,  a  questionnaire  had  to 
certain  data  on  the  student's  course  completion,  and  the  AFOQT  data  base  had  to  contain 
percentile  scores  on  the  student's  Academic  Aptitude,  Verbal,  and  Quantitative  composites.  Out 
oi  the  original  sample  of  1,465  questionnaires  received  from  the  training  schools,  a  total  of  968 
(66%)  remained  after  screening  for  completeness.  This  group  constituted  the  sample  used  for  the 
st 

Data  Analysis 

The  data  analysis  consisted  of  generating  a  Pearson  product-moment  correlation  matrix  using 
tee  R '  ar i ate  Subsample  Method  for  Missing  Data  (Stat  Job,  1973)  for  the  AFOQT  composite  scores 
ml  performance  data.  The  bivariate  method  Is  based  on  the  subsample  of  data  present  for 
doth  values  of  a  pair  of  variables  and  allows  the  Investigator  to  control  for  missing  data. 

IP  addition,  means  and  standard  deviations  for  each  AFOQT  composite  were  computed,  based  on 
.r,(  total  number  of  graduates  and  ellmlnees.  Means  and  Standard  deviations  were  also  computed 
i  academic  grade,  course  completion  and  student  class  rank. 


III.  RESULTS 


AFOQT  ?nd  Student  Performance 

Or.-  objective  of  this  study  was  to  determine  If  AFOQT  scores  were  correlated  with  student 
peri  .irr,.u  ce  In  the  five  major  air  weapons  controller  training  organizations.  The  higher  the 
correlation,  the  stronger  the  relationship  between  the  two  variables,  which  results  in  greater 
accuracy  of  prediction.  As  can  be  seen  from  Table  2,  there  (s  a  significant  positive  correlation 
i'-.iween  Ar  0Q1  composite  scores  and  student  performance  for  the  students  Included  In  this  study, 
'he  M  ;her  the  level  of  significance  (e.g.,  .01  Is  a  higher  level  of  significance  than  .05),  the 
greater  the  chances  that  the  obtained  statistical  correlation  resulted  from  a  real  relationship 
between  the  variables,  rather  than  from  chance  sampling  error.  All  five  of  the  composites  were 
positively  correlated  witn  the  performance  criteria  at  the  .01  level  of  significance.  This  level 
if  significance  leads  to  the  reasonable  assumption  that  the  correlation  did  not  occur  by  chance 
1i.  thn  s.‘-n!e  studied  and  that  this  composite  could  be  used  with  a  high  level  of  confidence  for 
predicting  the  performance  of  future  students  In  these  courses. 

Table  2.  Correlation  of  AFOQT  Scores  with  AFSC  1741 
Training  Performance  Data  -  Total  Group  Input 


AFOQT  Composite 


Criteria 

Pilot 

Navlgator- 
Techn  teal 

Academic 

Aptitude 

Verbal 

Quantl  - 

tat  ive 

Mean 

SD 

N 

Academic  Grade 

,228*v 

.284** 

.352** 

.280** 

.329** 

93.90 

4.82 

1186 

Success*- 

.191** 

.230** 

.263** 

.214** 

.256*i 

.9154 

.2885 

1453 

Student 

class  '•'ink 

.280** 

.392** 

.384** 

.311** 

.378** 

.5097 

.2910 

941 

aSucc  . s-  was  coded  0*FAII  ,  1-PASS. 
•Significant  at  .05  level. 

*S ‘ nn if  leant  at  .01  level. 
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Table  2  shows  that  all  of  the  AFOQT  composites  ware  able  to  predict  student  performance  using 
the  performance  criteria  that  were  chosen  for  this  study.  However,  each  of  the  composites 
yielded  a  different  quantitative  value.  A  closer  examination  of  the  data  shows  that  the  AFOQT 
Academic  Aptitude  composite  had  the  most  consistently  high  correlation  with  student  performance 
and,  thus,  would  be  the  best  single  predictor  of  student  perforeiance. 

Figures  1  and  2  graphically  show  the  relationship  between  the  AFOQT  Academic  Aptitude 
composite  and  success  or  failure  In  training.  As  can  be  seen  from  these  figures,  students  who 
failed  to  complete  their  training  had  lower  scores  on  the  AFOQT  Academic  Aptitude  composite  than 
those  who  completed  their  training.  In  Figure  1,  the  steeper  slope  of  the  attrition  line  below 
the  35th  percentile  shows  that  a  higher  percentage  of  attritions  (compared  to  the  percentage  of 
graduates)  occurred  at  the  lower  AFOQT  ecadenlc  aptitude  scores.  Figure  2  shows  more 
specifically  that,  below  the  35th  percentile,  there  were  more  attritions  than  completions,  while 
above  the  60th  percentile  the  reverse  Is  true.  There  appears  to  be  only  a  minimal  difference  in 
Academic  Aptitude  composite  scores  between  those  who  failed  In  training  and  those  who  completed 
training  for  scores  between  the  35th  and  60th  percentiles. 


Figure  1.  AFOQT  academic  aptitude  scores  and  cumulative  percent  graduates 
~~~  versus  attritions  in  AFSC  1241  training. 
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AFOQT  ACADEMIC  APTITUDE  COMPOSITE  SCORES  (PERCENTILE) 

Figure  2.  AFOQT  academic  aptitude  scores  and  percent  graduates 
versus  attritions  In  AFSC  1741  training. 


Tables  3  and  4  present  the  same  data  In  a  different  format.  Table  I  shows  the  percentages  of 
attritions  and  graduations  for  each  five  percentage-point  block  on  the  Academic  Aptitude 
composite.  The  change  from  a  negative  to  a  positive  difference  that  occurs  after  the  35th 
percentile  marks  a  clear  choice  for  the  upper  boundary  of  a  recommended  cutoff  score.  Table  4 
shows  the  cumulative  percentage  of  successful  and  unsuccessful  students  In  each  five 
percentage-point  Interval.  For  the  lower  end  of  the  composite  score  scale,  scores  between  01  and 
25  accounted  for  421  of  the  attritions,  but  only  111  of  the  graduating  students;  scores  from  01 
to  35  accounted  for  581  of  the  attritions  but  only  201  of  the  graduating  students.  As  this  table 
demonstrates,  the  '•hoi  v  of  a  selection  cutoff  score  Is  a  trade-off  between  losing  students  who 
would  have  graduated  from  the  schools  had  they  been  accepted  and  omitting  students  who  would  have 
failed  had  they  been  accepted.  This  issue,  along  with  a  set  of  recommendations  concerning 
minimum  selection  criteria,  will  be  addressed  in  more  detail  In  the  Discussion  section. 


Table  4.  AFOQT  Academic  Aptitude  Scores  and  Success  In  AFSC  1741 
Training  (Cumulative  Percentages) 


AFOQT 

Academic  Aptitude 
Composite  Score 

Possible 

Cutoff  Scores 

Cumulative 

X  Graduated 

Cumulative 
%  Not  Graduated* 

01-05 

1 

3 

06-10 

3 

10 

11-15 

6 

23 

16-20 

9 

34 

Recommended  Minimum  Cutoff  Range 

21-25 

25 

11 

40 

26-30 

30 

15 

48 

31-35 

35 

20 

59 

36-40 

26 

64 

41-45 

32 

70 

46-50 

39 

74 

51-55 

44 

BO 

56-60 

52 

86 

61-65 

57 

88 

66-70 

64 

89 

71-75 

69 

90 

76-80 

77 

94 

81-85 

82 

96 

66-90 

89 

98 

91-95 

96 

99 

96-99 

100 

100 

•This  coluan  can  be  used  to  predict  the  percentage  of  eventual  failures  who 
would  hare  been  eliminated  by  a  cut-off  score  at  each  successive  Academic 
Aptitude  score  Interval. 


Deaogrephlc  Factors  and  student  Perforaance 

Table  5  provides  the  correlations  between  the  socfo-deaographic  variables  exanined  in  this 
study  and  student  perforaance  (see  Reference  Note  3).  The  table  shows  that  the  Independent 
variables  (age  and  source  of  commissioning)  yielded  different  correlation  values  for  the 
different  criterion  variables.  Soae  were  higher  than  others,  giving  different  levels  of 
statistical  significance.  A  higher  correlation  Indicates  that  the  Independent  variable  Is  a 
better  predictor  of  the  criterion  variable.  This  means  that  each  correlation  must  be  evaluated 
In  terms  of  Its  level  of  significance;  the  .ilgher  the  level  of  significance,  the  greater  the 
confidence  that  It  would  successfully  predict  performance  In  a  study  with  future  students.  No 
significance  (less  than  .05)  for  a  variable  Indicates  that  It  would  not  successfully  predict 
performance  of  future  students.  In  the  present  study,  age  was  positively  related  to  the 
performance  criteria,  but  is  not  recommended  as  a  selection  criterion  because  of  the  difficulties 
Inherent  In  recruiting  older  students  as  career  field  entrants  and  because  FAA  research  has  shown 
that  this  relationship  tends  to  be  negative  after  the  age  of  30  (Cobb  &  Nelson,  1974;  Cobb, 
Young,  &  Rlzzutl,  1976;  Collins  et  al,  1981).  Correlation  of  source  of  commission  with  training 
Indicated  that  OTS  graduates  tend  to  pass  at  a  higher  rate  than  do  ROTC  graduates  and  to  perform 
better  academical  ly. 
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Table  5.  Correlation  of  Demographic  Variable*  with  AFSC  17*1 
Training  Performance  Data  -  Total  6roup  Input 


Criterion 

Age 

In  Years 

Source  of 
Commissioning* 

Mean 

SD 

N 

Academic  Grade 

.117 

-.092* 

93.90 

4.82 

1186 

Success*1 

.160** 

-.152* 

.9154 

.2885 

1453 

Student  Class  Rank 

.ijo 

» 143** 

.5099 

.2910 

941 

Mean  (Grads  +  Elimlnees) 

26.65 

.630 

SD  (Grads  +  Elimlnees) 

3.17 

.499 

N 

156 

577 

♦Significant  at  .05  level 
♦♦Significant  at  .01  level. 

•Source  of  comission  was  coded:  0«0TS,  t»R0TC. 
bSuccess  was  coded:  0«FAIL,  1«PASS. 

A  separate  analysis  was  done  to  answer  the  question  concerning  whether  students  in  these 
training  programs  who  had  previously  been  eliminated  from  undergraduate  pilot  training  (UPT) 
performed  as  well  as  the  students  without  this  particular  background.  The  obtained  success  rates 
were  91%  for  both  groups. 

Table  6  provides  data  concerning  how  well  students  In  the  air  weapons  controller  training 
programs  performed  on  the  AFOQT  Verbal,  Quantitative,  and  Academic  Aptitude  composites,  as 
compared  to  personnel  In  several  other  career  fields.  Although  the  average  scores  for  the  air 
weapons  controller  sample  are  somewhat  lower  than  the  scores  for  the  other  career  fields  listed, 
they  are  higher  than  those  obtained  for  tha  Air  Force-wide  officer  population.  This  table 
Indicates  that  the  17XX  career  field  Is  receiving  students  whose  abilities  are  roughly  comparable 
to  those  of  other  critical  career  fields.  Adoption  of  a  selection  criterion  such  as  that 
presented  In  this  report  would  result  In  an  Increase  In  the  average  composite  scores  for  the  17XX 
population.  Hore  Importantly,  It  would  lower  the  training  program  attrition  rate,  assuming  that 
there  were  no  changes  In  the  school  attrition  rate  policies.  Whether  to  adopt  n  selection 
criterion  for  this  career  field  can  be  determined  only  by  a  high-level  management  review  and 
decision  process  aimed  at  a  policy  that  would  provide  an  adequate  number  of  proficiently  trained 
and  operationally  qual1f1:d  air  weapons  controllers,  while  minimizing  the  attrition-related  costs. 

Table  S.  Mean  AFOQT  Composite  Scores  -  Air  Weapons  Controllers 


(AFSC  1741) 

vs.  Other 

Career  Fields 

Academic 

N 

Verbal 

Quantitative 

Aptitude 

UPT 

2680 

67.2 

68.6 

66.1 

AFSC  51XX 

178 

62.4 

62.4 

67.0 

UNT 

787 

62.4 

65.5 

66.5 

AFSC  17XX® 

968 

60.4 

49.9 

56.0 

AF-Wlde 

47.4 

45.3 

45.2 

•These  means 

are  only  for  the 

17XX  students  Included  In  this 

study. 

IV.  RECONKENDATIOHS 


Because  of  the  generally  high  attrition  rates  and  associated  costs  in  the  training  progress 
for  this  career  field.  It  Is  recommended  that  a  minimum  selection  criterion,  using  the  AFOQT 
Academic  Aptitude  composite,  be  Implemented  as  soon  as  practical. 

As  Tables  3  and  4  show,  the  greatest  gain  In  reducing  the  air  weapons  controller  attrition 
rate,  while  minimizing  the  loss  of  potentially  acceptable  students,  can  be  made  by  setting  a 
minimum  AFOQT  Academic  Aptitude  composite  score  In  the  range  between  25  and  35.  A  cutoff  score 
of  25  on  this  composite  should  deny  admission  to  approximately  40*  of  those  students  whc  would 
eventually  fall  to  complete  their  training  (and  to  11*  of  those  who  might  have  passed),  while  a 
minimum  cutoff  of  35  should  deny  admission  to  approximately  59*  of  future  failures  (and  to  20*  of 
those  whc  would  likely  have  succeeded). 

To  achieve  the  same  number  of  training  program  graduates,  more  potential  students  would  have 
to  be  tested,  but  less  would  have  to  be  enrolled.  Each  successively  higher  cutoff  score  up  to  35 
eliminates  more  potential  attritions  than  potentially  successful  students.  After  that  point, 
higher  cutoff  scores  would  either  eliminate  the  same  number  of  potential  attritions  as  successful 
students  or  would  actually  eliminate  more  potentially  successful  students  than  elfmlnees.  Thus, 
a  cutoff  score  of  35  would  maximize  the  efficiency  of  using  the  Academic  Aptitude  composite  as  a 
selection  criterion. 

The  choice  of  a  specific  cut-off  score  from  this  range  Is  an  Air  Force  management  policy 
decision  and  should  be  determined  primarily  by  the  need  to  obtain  a  specified  minimum  number  of 
operationally  qualified  air  weapons  controllers  from  the  number  of  available  students. 
Regardless  of  which  cutoff  score  Is  chosen.  It  Is  recommended  that  it  be  tried  for  a  period  of  18 
months.  The  following  possibilities  would  exist  at  the  end  of  this  18-month  trial  period: 

1.  The  attrition  rate  has  been  reduced  to  an  acceptable  level  and  the  required  number  of  new 
air  weapons  controllers  Is  being  provided  by  the  training  pipeline  --  no  changes  In  policy  are 
required. 

2.  The  attrition  rate  has  been  lowered  to  an  acceptable  level  but  Insufficient  numbers  of 
r.ew  air  weapons  controllers  are  being  provided  —  this  would  require  a  re-examination  of  career 
field  recruitment,  selection,  and  management  policy. 

3.  The  attrition  rate  h«s  not  been  lowered  to  an  acceptable  level  —  this  would  require 
raising  of  the  minimum  cutoff  scores,  a  larger  scale  research  and  development  effort  to  produce  e 
unique  selection  test  battery  for  this  career  field,  reexamination  of  school  policies  regarding 
acceptable  levels  of  performance  for  graduation,  or  modification  of  training  programs  to  provide 
remediation  to  students  who  are  not  able  to  pass  through  the  ’normal"  pipeline. 

Implementation  of  any  of  these  choices  would  require  a  decision  by  Air  Force  Headquarters  and 
the  appropriate  HAJCOH. 


REFERENCE  NOTES 


1.  The  following  letters  and  reports  document  concern  regarding  lack  of  specific  selection 
criteria  for  the  air  weapons  controller  career  field: 

Gagllo.  S.  S.  (1981,  August).  Survey  of  S.  I,  A.  Unpublished  manuscript,  2625  Technical 
Training  Squadron,  Tyndall  AFB,  CL  32403-5000. 

lee,  R.  J.  (1981,  September).  Letter  re:  APQ  student  elimination,  FY81.  From  USAF 
Interceptor  Weapons  School/TQTA  to  USAF  Interceptor  Weapons  School/CC,  Tyndall  AFB,  FL 
32403-5000. 

North,  J.  C.  (1979,  Hay),  letter  re:  Minutes  of  AFKRl/552  AWACW  meeting  concerning  weapons 
director  selection  study.  From  HQ  5520  Airborne  Warning  and  Control  Wing,  552  AWACW/DOP,  to 
meeting  participants. 

Pahls,  G.  (1981,  April).  Memo  for  Record  re:  Analysis  of  entry  level  weapons  controller 
training  for  FY80.  USAF  Interceptor  Weapons  School,  USAF  IWS/TT,  Tyndall  AFB,  FL  32403-5000. 

Rothe,  H.  A.,  Granade,  6.  T. ,  Jr.,  Savana,  H.  J.,  Jr.,  Gagllo,  S.  S.,  A  Stockmaster,  M. 
(1980,  October),  Analysis  of  weapons  controller  course  ellmlnees.  Unpublished  manuscript, 
Capt  Ben  Granade,  3625  Technical  Training  Squadron,  Tyndall  AFB,  FL  32403-5000. 

2.  A  meeting  of  representatives  from  the  training  and  air  weapons  controller  career  management 
communities  and  Air  Force  Headquarters  (USAF/XOORC)  was  held  on  29  and  30  Sep  1981  at 
Wrlght-Patterson  AFB,  OH.  The  purpose  of  the  meeting  was  to  consider  alternative  solutions 
to  air  weapons  controller  training  cost  and  attrition  rate  Issues.  Four  options  were 
discussed:  (a)  raise  performance  standards  (and,  thereby,  the  attrition  rates  In  the  basic 
schools),  to  decrease  downstream  attrition  and  Blrlslie  the  number  of  "marginal  performers* 
who  enter  operational  units;  (b)  establish  minimum  aptitude  entrance  standards;  (c)  use  a 
combination  of  the  first  two  alternatives;  and  (d)  generate  a  Request  for  Personnel  Research 
for  AFHRL  development  of  a  special  selection  test  battery  for  this  career  field.  The  last 
option  Involved  the  Irvestlgatlon  of  a  psychomotor  device  previously  developed  for  pilot 
selection,  the  development  of  experimental  paper-and-pencll  tests,  or  the  development  of  a 
totally  new  psychomotor  device.  Those  attending  the  meeting  chose  Option  b. 

3  Some  of  the  training  school  representatives  requested  consideration  of  data  on  sex  and  raca 
as  possible  predictors  of  training  performance.  These  data  were  collected,  but  are  not 

presented  because  their  use  as  selection  criteria  Is  not  feasible.  Analysis  of  these  data 
Indicate  that  neither  race  nor  sex  had  consistently  significant  correlations  with  training 
program  performance. 
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APPENDIX  A: 


1 7 X X  TRAINING  ORGANIZATIONS  AND  COURSES 


3625  Technical  Training  Squadron,  Tyndall  AFB,  FL  (Air  Training  Command) 

1.  E30BP-1741X-000  Air  Weapons  Controller  Fundamentals  -  6-week  training  course  for 

personnel  initially  entering  the  career  field 

for  later  assignment  to  automated  operational  units. 

2.  E30BP-1741A-003  Air  Weapons  Controller  Fundamentals  Manual.  13-week  course  for 

personnel  Initially  entering  the  career  field  for  later  assignment  to  manual 
operational  units. 

USAF  Interceptor  Weapons  School,  TyndaTl  AFB,  FL  (Tactical  Air  Conaand) 

17A1BOO  —  10-week  course  for  students  who  have  completed  basic  manual  system 

training.  Provides  automatic  positionally  qualified  (APQ)  training  as  intermediate 

training  for  students  transitioning  into  units  with  automatic  equipment  (SAGE/BUIC/ 

AWACS). 

966  Airborne  Warning  and  Control  Squadron,  Tinker  AFB,  OK  (Tactical  Air  Command) 

1.  E3AOOCOOBX  --  18-week  training  program  for  AWACS  Senior  Directors/ 

Mission  Crew  Commanders. 


2.  E3A00C0UDX  —  24-week  training  program  for  AWACS  Weapons  Directors. 

3.  E3AOOCOOGX  —  19-week  training  program  for  AWACS  Air  Surveillance  0 

4950  Technical  Training  Wing,  Keesler  AFB,  MS  (Air  Training  Command) 

30LR 1741D-002  —  8-week  training  program  In  Electronic  Counter- 
CECC.M) 


i  r  * 


Counter 


Measures 


607  Technical  Training  Squadron,  Luke  AFB,  AZ  (Tactical  Air  Command) 

1741-FOL  —  7-week  training  program  In  automated  40/1  radar  system 
for  students  being  assigned  to  operational  units  with  this  equipment. 
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